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Abstract — We propose two approximate algorithms for 
MAP decoding on tail-biting trellises. The algorithms work 
on a subset of nodes of the tail-biting trellis, judiciously 
selected. We report the results of simulations on an AWGN 
channel using the approximate algorithms on tail-biting 
trellises for the (24, 12) Extended Golay Code and a rate 
1/2 convolutional code with memory 6. 

I. Introduction 

In this paper we propose a new approximate MAP de- 
coding technique on tail-biting trellises that exploits the 
subtrellis structure of the tail-biting trellis to compute ap- 
proximate aposteriori probabilities (APPs) of codeword 
symbols. Our algorithm is best described as a best-search 
algorithm, meaning thereby, that the algorithm tries to 
track those subtrellises which are most likely to contain 
the transmitted codeword and computes marginals over 
these only. Our approximate decoder works rather ef- 
ficiently at higher values of signal to noise ratios. We 
compare our results with those obtained by the wrap 
version of Anderson-Hladik MAP decoder [2], which 
we refer to as the AH-decoder. The rest of the paper is 
organized as follows. Section |ll| gives some background. 
Section |in]describes the decoding algorithm. Section llVl 
describes a simple modification to the scheme. SectionlVl 
presents the results of simulations on an AWGN channel 
on a 16 state tail-biting trellis for the (24, 12) Extended 



Golay code and a 64 state tail-biting trellis for a rate 1/2, 
memory 6, convolutional code. Section lVTI concludes the 
paper. 

II. Background 

Tail-biting trellises for convolutional codes were in- 
troduced in [8] and those for block codes in [3], [4]. 
For ease of notation we view the tail-biting trellis T — 
(V, E, F q ), of depth n, to be defined on a sequential 
time-axis with Vq = V n and all valid paths restricted to 
those that begin and end at the same state. We call Vb 
and V n respectively the start and final states of T. In [5], 
[6], [7], [8] it was shown that a tail-biting trellis could be 
viewed as the superposition of subtrellises obtained from 
a coset decomposition of the code represented by it with 
respect to a subgroup. Corresponding to each start state 
of the tail-biting trellis we define a subcode consisting 
of all codewords that begin and end at the same state. 
These subcodes all have identically structured subtrel- 
lises (though with different labels), and share states at 
various time indices. This subtrellis structure is exploited 
to give an approximate MAP decoding algorithm. 

III. Approximate Decoding on Tail-biting 
Trellises 

In order to explain the approximate MAP algorithm 
we define the weight of a subtrellis Tj conditioned on 



the received vector r as 

weight(Tj) = ^ Pr(c|r) 

where Cj is the subcode represented by Tj . The weight 
of a subtrellis is the aposteriori probability that the 
transmitted codeword lies in the particular subtrellis. The 
weight of a subtrellis is also the maximum contribution 
a subtrellis can make to the decision sums for computing 
the APP of any digit of the codeword. The basic idea 
in MAP Approximate Algorithm (MAA) is to start off 
by obtaining initial estimates to the weights of the 
subtrellises. The initial estimates are all overestimates. 
We begin with the best subtrellis with respect to the 
current estimates and begin a forward pass on that 
subtrellis. We define our updating function for estimates 
as we progress along sections of the current trellis such 
that the overestimates become more and more accurate as 
we go along, always converging to the exact value at the 
end. Each time we move from one section to the next, 
we check the updated estimate against those of other 
subtrellises and switch to another subtrellis if it appears 
more likely to be the correct one. Thus the algorithm may 
switch from one subtrellis to another during the course 
of execution. However, it is always guaranteed to finish 
on the most likely subtrellis. The same is done for the 
backward pass. Now after the two passes are over, there 
will be subtrellises for which certain sections have been 
opened only in the forward or backward pass but not 
both. In the final marginalization phase we ignore these 
sections of subtrellises which have not been opened by 
both the passes. 

A. Node Objective Functions 

Given a one-to-one tail-biting trellis T = (V,E,¥ q ) 
of depth n, we use the following notation. We denote 
the label of an edge e G T by /(e). For an edge 
e = (u,v) G T we define predecessor and successor 
operators as Init(e) = u and Term(e) = v. By nodes 
of T we refer to the vertices of T. The start node of 
a subtrellis Tj is denoted by Sj and the final node by 



fj. The set of all paths in the tail -biting trellis from 
node u to node v is denoted by P(u,v). Further let 
P(U,V) = U ue u,vevP{u,v) denote the set of paths 
from nodes in U to nodes in V. 

Given a received vector r we annotate the edges of the 
tail-biting trellis suitably using the channel information 
so that the codeword APP gets decomposed along the 
edges of the codeword path. The weight of an edge is 
denoted by w(e). We then define the weight of a path as 
the product of the weights of the edges constituting the 
path. The weight of a subtrellis Tj, as defined previously, 
is then the sum of the weights of all paths in Tj. 

The approximate algorithm computes a set of node- 
objective functions on the nodes of the tail-biting trellis. 
These function definitions are identical to the forward- 
backward passes defined in [1]. 

olt and 0t are functions whose domain is the nodes 
of the tail-biting trellis T. They are defined recursively 
as 

ax{v) := aT(Init(e))w(e) 

e: Term(e)—v 

0r(v) := MTerm(e))w(e) (1) 

e:Init(e)—v 

with a T (V Q ) := f3 T (V n ) := 1. 

This is just a forward-backward pass on T, initialized 
according to the boundary conditions. 

Also corresponding to each subtrellis Tj we define two 
functions and (3^ whose domain is the set of nodes 
belonging to Tj. and flx, at a node u capture the 
computational effects of exclusive forward and backward 
passes respectively on Tj at u. 

OLTj at a node u G Tj is defined inductively as 

a Tj (u) := ^2 a Tj (Init(e))w(e) (2) 

eeTj-.Term(e)=u 

with ctTj (sj) ■= 1. 

Similarly [3^ at a node u G Tj is defined inductively as 

(3 Tj {u) := Y, P T] {Term(e))w(e) (3) 

eGTj :Init(e)—u 

with /, ;./•,: 1. 

It can be seen that at a node u G Tj is the sum of 



the weights of all paths in P(sj,u), while /3y. at u is 
the sum of the weights of all paths in P(u, fj). Similarly 
olt at a node u E T gives the sum of the weights of all 
paths in P(Vq,u) whereas j3r at u gives the sum of the 
weights of all paths in P(u, V n ). 

B. The Approximate MAP Algorithm 

We now give an informal description of the MAP 
Approximate Algorithm (MA A). 

MAP-AA 

Input : A one-to-one tail-biting trellis T = (V,E,¥ q ) 
of depth n, with edge weights suitably defined using the 
received vector r and channel information 
Output : A vector of approximations to Pr(ci = <r|r) 
for a E F q and i = 1,2, ... ,n 

1) Phase 1: This phase computes the node-objective 
functions ay and (3t with respect to the tail-biting trellis 
T by executing a forward-backward pass on T with 
boundary conditions as suggested by Recursion ^ 

2) Phase 2: This phase computes a set of node- 
objective functions ay. and (3tj with respect to the 
subtrellises that share the node. It consists of a forward 
and a backward pass. 

A node can be shared among many subtrellises and 
will belong to the domain of the functions defined with 
respect to these subtrellises. MAA computes a subset of 
these functions either partially or completely. 

a) Forward Pass: At each step in the forward 
pass the approximate algorithm first chooses a winning 
subtrellis T w . It then computes ar m for the next section 
of T w using Recursion |2 The winning subtrellis is one 
at which a suitably defined heuristic function, hf, is 
maximized. We associate a working index with each 
subtrellis. The working index of a subtrellis Tj gives the 
last section of the tail-biting trellis at which the node- 
objective function has been computed. 

The forward pass works along the following lines. The 
working indices are initialized to the start section and 
the boundary conditions of Recursion |2] are enforced. 



We start by choosing a winning subtrellis T w from the 
set of | Vol subtrellises defined on T such that hf is 
maximized at T w . The heuristic function at a subtrellis 
Tj with a working index k is a function of and 
Pt at section k in T. We describe the heuristic function 
in detail later. If the working index of T w is the final 
section, we successfully exit from the forward pass. 
Otherwise we increment the working index to the next 
section. Using the values of ax TO at the nodes of previous 
working index of T w , we then compute ar m at the nodes 
of the current working index according to Recursion [2] 
After computing ar m for the current working index, we 
re-evaluate the heuristic function at T w . We then go back 
to the process of choosing the winning subtrellis and 
computing the corresponding node-objective function at 
the next working index of the winning subtrellis. 

The heuristic function at Tj with working index k is 
defined as 

hf{Tj,k):= a Tj (u)(3 T (u). 

We now motivate this definition of the heuristic function. 
Let Hj be the set of paths in P(Vq, V n ) whose first k 
edges lie in Tj . It can be seen that h / (Tj , k) is the sum of 
the weights of paths in IT| . Note that h / (Tj , 0) = (3 T (sj) 
is the sum of weights of paths in P(sj, V n ). 
Now observe that n^ +1 C EE*. Since the edge-weights 
are probabilities and therefore non-negative, this implies 
that 

M^,fc + i)<M^>*0- 

Also by definition II™ = Tj and as a consequence 

hf(Tj,n) — weight(Tj). 

It follows that the heuristic for Tj keeps falling after each 
revision and finally converges to the weight of Tj. Thus 
at any instant the heuristic for Tj is an over-estimate to 
the weight of Tj. If a forward pass has been completed 
on a subtrellis Tj, the approximate algorithm guarantees 
that a forward pass will be completed on all subtrellises 
Xfc with weight(Tk) > weight(Tj). 



b) Backward Pass: In the backward pass we com- 
pute a set of node-objective functions flx, with respect 
to subtrellises Tj as dictated by Recursion [5] The 
backward pass is similar in spirit to the forward pass 
except for the definition of the heuristic function and 
the backward direction of computational flow on the 
trellis. The computation starts by initializing the working 
indices of subtrellises to the final section and ends when 
the working index of the winning subtrellis is the start 
section. 

The heuristic function at Tj with working index k for 
the backward pass is defined as 

h b (Tj,k):= ^ {3t 3 (u)ut(u)- 

It can be seen that hb(Tj, k) is the sum of weights of all 
paths in P(Vq, V n ) whose last n — k edges lie completely 
in Tj. It follows that all the properties noted for the 
heuristic function along the forward pass carry over to 
the heuristic function for the backward pass. 

3) Phase 3: This phase computes the approximate 
marginals corresponding to each symbol a and each 
position i. We compute the approximate aposteriori 
probabilities Pr(ci = <r\r) as 

w(e) Qj-r,. {Init{e))pr s (Term(e)). 

eGEiA(e)=a j 

The product in the inner-sum is taken over only those 
node-objective functions which have been computed. 

IV. A Simple Modification 

By restricting the Phase 2 of MAA to work with 
a fixed number of subtrellises say /i, we can reduce 
the storage requirements of the algorithm at the cost 
of incurring a further penalty in the accuracy of the 
APPs computed. In order to decide the /j, subtrellises 
to work with, we evaluate min(hf(Tj, 0), /i&(T}, n)) at 
each subtrellis Tj and choose the first /i subtrellises at 
which this quantity is the largest. 
The rationale behind this choice is that both hf(Tj,0) 
and hb(Tj,n) are overestimates to the weight(Tj) 
and the minimum of the two is nearer to the true 



BER for MAA, 4-MAA and Anderson-TBT Algorithms for (24,1 2) Golay code 



0.1 



0.01 



0.0001 









'MAA' — *— 
'4-MAA' — X— 
Anderson-TBT — h — 

































1 2 3 4 5 

Eb/NO dB 

Fig. 1. BER for the MAA, 4-MAA and AH-Decoder (Wrap=10) 
algorithm for the (24,12) Extended Binary Golay Code 

weight of Tj. We call this modified scheme as the 
/j-MAP Approximate Algorithm (/i-MAA). Surprisingly 
this scheme gives pretty good results for the codes on 
which we have run experiments. 

V. Simulation results 

We have coded the MAA, 4-MAA and AH-Decoder 
and shown the results of simulations on the minimal 
16 state tail-biting trellis [3] for the extended (24,12,8) 
Golay code and a 64 state tail-biting trellis for a rate 
1/2 convolutional codes with memory 6 (equivalent to 
the (554,744) convolutional code of [2]), with circle size 
48. This is the same code experimented on in [2] . The 
channel model used is an AWGN channel with antipodal 
signaling. The source bits were assumed to be equally- 
likely. 

For the convolutional code we show the variation of 
the average number of forward-backward updates with 
the signal to noise ratio for the MAA and compare it 
with the number of forward-backward updates required 
by the AH-Decoder. 

We also show the variation of average number of sub- 
trellises explored by the Phase 2 of MAA with signal to 
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Fig. 2. BER for the MAA, 4-MAA and AH-Decoder (Wrap=40) 
algorithm for the rate 1/2 (133,171) Convolutional Code with circle 
length 48 

noise ratio. The tail-biting trellis representing the code 
has 3072 states and 64 subtrellises. Each subtrellis has 
2493 states. The result is displayed in Table [I] It can be 
seen that at moderate to high SNR, the Phase 2 of MAA 
seems to work on only a single subtrellis. 

We also display the performance of the MAA, 4-MAA 
and AH-Decoder in Figuresrj]and[2]and find that there is 
virtually no difference in the bit error rates for the three 
algorithms for the convolutional code. For the Golay 
code the MAA and the 4-MAA seem to do slightly better 
than the AH-Decoder. 

VI. Conclusion 

We have shown that at the expense of some extra 
space we can obtain approximate algorithms with 
good performance for MAP decoding on tail-biting 
trellises. Simulations on tail-biting trellises for the 
(24,12) Extended Golay code and a rate 1/2, memory 
6 convolutional code used in [2] have been carried out 
and the results on an AWGN channel are reported. 



SNR 


avg updates 
by MAA 


avg updates by 
AH-Decoder 


avg no: of subtrellises 
examined by MAA 


0.0 


91867 


22528 


7.60 


0.5 


53737 


22528 


4.04 


1.0 


34113 


22528 


2.16 


1.5 


25984 


22528 


1.38 


2.0 


23087 


22528 


1.11 


2.5 


22230 


22528 


1.02 


3.0 


22049 


22528 


1.00 


3.5 


22014 


22528 


1.00 


4.0 


22008 


22528 


1.00 


4.5 


22008 


22528 


1.00 


5.0 


22008 


22528 


1.00 



TABLE I 

Runtime statistics for the MAA and AH-Decoder 
(Wrap=40) for the rate 1/2, memory 6, [133, 171] 
convolutional code with circle length 48. 



References 

[1] L.R. Bahl, J. Cocke, F. Jelinek, and J. Ravfv, Optimal decoding 

of linear codes for minimizing symbol error rate, IEEE Trans. 

Inform. Theory, 20(2), March 1974, pp. 284-287. 
[2] J.B. Anderson and S.M. Hladik, Tail-biting MAP Decoders, IEEE 

Journal in Selected Areas in Communication, 16(2), February 

1998. 

[3] A.R. Calderbank, G.D. Forneyjr., and A. Vardy, Minimal Tail- 
Biting Trellises: The Golay Code and More, IEEE Trans. Inform. 
Theory, 45(5), July 1999, pp. 1435-1455. 

[4] R. Koetter and A. Vardy, On the theory of linear trellises, 
Information, Coding and Mathematics (M. Blaum, Editor), 
BostomKluwer, May 2002. 

[5] P. Shankar, A. Dasgupta, K. Deshmukh and B.S. Rajan, On 
Viewing Block Codes as Finite Automata, Theoretical Computer 
Science, 290(2003) 1775-1797. 

[6] Yaron Shany and Yair Be'ery, Linear Tail-Biting Trellises, the 
Square-Root Bound, and Applications for Reed-Muller Codes, 
IEEE Trans. Inform. Theory, 46(4), July 2000, pp 1514-1523. 

[7] Shu Lin and R.Y.Shao, General Structure and construction of Tail 
Biting Trellises for Linear Block Codes, in Proc. 2000 Int. Symp. 
Inform. Theory, Sorrento, Italy, pp 117. 

[8] G.Solomon and H.C.A. van Tilborg, A connection between block 
and convolutional codes, SI AM J. Appl. Math., 37, October 1979, 
pp 358-369. 

[9] R. Johanesson, K. Sh. Zigangirov, Fundamentals of convolutional 
coding, IEEE Press, New York, 1999 



